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Abstract— The Extended BP (EBP) Generalized EXIT 
(GEXIT) function introduced in [4] plays a fundamental role in 
the asymptotic analysis of sparse graph codes. For transmission 
over the binary erasure channel (BEC) the analytic properties 
of the EBP GEXIT function are relatively simple and well 
understood. The general case is much harder and even the 
existence of the curve is not known in general. We introduce 
some tools from non-linear analysis which can be useful to prove 
the existence of EXIT like curves in some cases. The main tool 
is the Krasnoselskii-Rabinowitz (KR) bifurcation theorem. 

I. Introduction 

The Extended BP (EBP) GEXIT function introduced in [4] 
plays an important role in the analysis of iterative coding 
systems. For transmission over the binary erasure channel 
(BEC) this function encodes both the behavior of the BP as 
well as the MAP decoder in the asymptotic limit of infinite 
blocklengths. Further, in this case the EBP GEXIT function 
has a very simple analytic expression in terms of the degree 
distribution of the ensemble. 

It is conjectured that the fundamental characteristic of 
EBP GEXIT functions remains valid also for general (binary 
memoryless symmetric) channels. Figure Q] shows the EBP 
GEXIT function for the degree distribution pair (k(x) = 
0.25x + 0.75x 7 , p(x) —x 1 ), assuming that transmission takes 
place over the binary symmetric channel (BSC). Note that 
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Fig. 1: EBP GEXIT function for X(x 
and Binary Symmetric Channel. 



0.25x + 0.75x 7 , p(x) =x 7 

this curve smoothly connects the point (1,1), corresponding 
to the channel BSC(±), with the point (/! stab ,0), where h st * b 
corresponds to that channel parameter at which the coding 
system changes its stability behavior. The curve was computed 
using a procedure suggested in [4]. 

This procedure guarantees in general the existence of a fixed 
point density for every point on the vertical axis. Unfortu- 
nately, it does not guarantee that the set of fixed points so 
computed forms a smooth one-dimensional manifold. Such a 



property however, is required in order to complete the theory 
of EBP GEXIT functions. E.g., it is known that if the curve 
is smooth then the area it encloses is equal to the code rate. 
Combined with the General Area Theorem (first proved for 
the BEC in [5] and then extended to the general case in 
[4]) this statement on the area gives rise to bounds on the 
MAP performance for sparse graph codes. For the BEC it has 
been shown that in many cases the bound is tight and it is 
conjectured to be tight not only for the BEC but also in the 
general case. 

The existence of the EBP GEXIT function is therefore a 
fundamental question at the heart of the asymptotic theory of 
sparse graph codes. We introduce some tools from non-linear 
analysis which can be useful to prove the existence of EXIT 
like curves in some cases. The main tool is the Krasnoselskii- 
Rabinowitz (KR) bifurcation theorem. 

II. Definitions and Theorem Related to the 
Existence of Fixed Points 

As discussed in the last section, it is a difficult task to prove 
the existence of the EBP GEXIT curve for general channels. 
I.e., it is difficult to prove that the set of fixed point densities 
of density evolution forms a differentiable one-dimensional 
manifold. 

Although we currently do not know how to prove the exis- 
tence for the general case, a fundamental theorem of non-linear 
analysis, called the Krasnoselskii-Rabinowitz (KR) theorem ( 
[1], [2]), can be helpful in some instances to establish the 
existence of an unbounded connected component of fixed 
points. To be more precise: density evolution represents a 
non-linear map in the space of densities. If we are given a 
degree distribution pair with a non-zero fraction of degree- 
two variable nodes and a family of BMS channels, then this 
map has a bifurcation point for that channel parameter which 
corresponds to the stability condition. In other words, consider 
the channel parameter for which the linearization of the density 
evolution map around the density corresponding to perfect 
decoding has its largest eigenvalue equal to one. Then this 
channel parameter is a bifurcation point. Under some technical 
conditions the KR theorem then guarantees that there is a 
connected set of fixed points which starts at this bifurcation 
point and which either extends to infinity or which connects 
back to another bifurcation point. This is not quite as strong 
a statement as we would wish: we are not guaranteed that 
this connected set forms a smooth manifold, nor do we know 



that the curve connects to the fixed point corresponding to the 
worst density and worst channel. Nevertheless, if the theorem 
applies, we at least know the existence of the EBP GEXIT 
curve locally around the stability point. Before we can show 
some cases where the KR theorem can be applied let us 
quickly review the main notation and the main statement. 

We denote a generic Banach space by X (e.g. X = R N ). We 
denote elements of X in boldface letters, i.e., x G X. We denote 
the space of bounded linear operators from X to X by L(X). 
We are interested in maps of the form G : R xX — > X. The 
argument 7 of G(y,x) is called the parameter. In our setting 
the parameter will be the channel parameter (e.g., the erasure 
probability of the BEC or the cross-over probability for the 
BSC). Recall the following definitions: 

• Completely Continuous (CC) Map: A map G : R xX — > 
X is CC if it maps every bounded set A of IR xX to a 
relatively compact set in X. 

• Frechet differentiable: Let G: RxI^X be a map such 
that G(y,0) =0. G is Frechet differentiable at x = 
if there exists T £ L(X) such that, given e > and an 
interval [70,71] of R, there exists 8 > with the property 
that I |y| I < 8 implies 

l|G(7,y)-7Ty|| 
llyll 

for all 7G [70, 71]. Note that 8 depends on both the choice 
of interval and the value of £. We say that yT is the 
Frechet derivative of G at 0. 
We denote the set of non trivial fixed points of G by S = 
{(Y,x) : G(y,x) =x,x/0} and the closure of S by S. If a point 
(jU,0) £ S, then the number p. is called a bifurcation point for 
the solutions to G(y,x) =x. 

Theorem 1 (KR Theorem): [1, Theorem 17.8] Let X be a 
Banach space and let G : IR xX -^Ibea map. Let S= {(7,x) : 
G(y,x) = x,x ^ 0} be the set of non trivial fixed points of G 
and let S denote the closure of S. Assume that the following 
hypothesis holds. 

1) G(y,x) is a completely continuous map. 

2) G(y, x) is Frechet differentiable at 0, with Frechet deriva- 
tive yT. 

3) Let i be an eigenvalue of T which is of odd algebraic 
multiplicity. 

Then there exists a maximal closed connected subset C p of S 
which contains (p,0) and one of the following is true. 

1) Cfj is unbounded in IR xX. 

2) Cfj contains (p*,0) for some other bifurcation point p* ^ 
p. 

A graphical representation of the KR theorem is shown in 
Figure [2] 

Our basic plan of attack is the following. In our setting 
x will denote a density, and G will be the density evolution 
map. We want to parametrize the space in such a way that 
denotes the desired fixed point corresponding to perfect 
decoding. The parameter p will parametrize the channel. If we 
can show that the linearization of the density evolution map 
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Fig. 2: The solid curve shows how the component Cu would look 
like if the first conclusion of theorem holds and the dotted one shows 
the how the component Cfj would look like if the second conclusion 
holds. 

around has eigenvalue l/p, where p denotes the channel 
parameter which corresponds to the stability condition, and if 
the linearization fulfills the desired technical conditions, then 
there is a connected component of fixed-points which either 
extends to infinity or is connected to another bifurcation point. 
At least locally, we will therefore have proved the existence 
of a connected component of fixed points. 

In the following it is also good to know the following fact. 

Theorem 2: [1, Theorem 17.4] Let G : R xX ->I be a 
completely continuous and Frechet differentiable at 0, with 
derivative yT. If jj is not an eigenvalue of the compact linear 
operator T, then there exist e,r| > such that G(y,x) ^x for 
all (y,x) for which \y—p\ < E and < ||x|| < T|. In particular, 
p is not a bifurcation point for the solutions to G(y,x) =x. 

We also use the following terminology in the rest of the 
paper. Let G : R x R N -> R N be a map of the form G = {Gi}f =v 
where G, : R x R N — > R is a multivariate polynomial in the 
components of x and G,-(/j,x) = G\ (x)+pGf(x). Then we say 
that G is a vector polynomial map. 

III. Examples 

In principle, we would like to apply the KR theorem 
directly to the BP or min-sum decoder. But there are some 
technical conditions that make the direct application difficult. 
For example, the bifurcation point for the BP decoder appears 
when the Bhattacharyya parameter is equal to ^'(o/p'm ■ This 
suggest that the Bhattacharyya parameter should play the role 
of the parameter in the setting of the KR theorem. The theorem 
requires that the parameter 7 takes on values in R and not 
only on [0, 1]. Therefore, we can not just work in the space of 
symmetric densities (for which the Bhattacharyya parameter 
is in the range [0, 1]) but we are required to extend the space. 
How this is best done is currently an open question. Because 
of these technical difficulties, we consider quantized decoders. 
First we show the application of the KR theorem to the 
simplest possible case. 

Example 1 (BP Decoder for Binary Erasure Channel): It 
is instructive (and easy) to analyze the fixed points of the 
density evolution map for the BEC(e). Consider a degree 
distribution pair (A,,p) with A/(0)p'(l) > 0. 

The density evolution recursion reads 

xi =ek(l -p(l -X1-1)). 



We take the space X to be X = R and set G(s,x) = 
ek(l — p (1 — x)). Here the erasure probability e plays the 
role of the parameter. As G(e,x) is a polynomial map, it is 
completely continuous by Lemma [T] and Frechet differentiable 
by Lemma [2] From Lemma 12 the Frechet derivative of G(e,x) 
is given by eTx — eX' (Q)p' (l)x. Thus the parameter e appears 
multiplicatively, as required by the KR theorem. 

Trivially, A/(0)p'(l) is the eigenvalue of the operator T and 
this eigenvalue has multiplicity one (the space is only one- 
dimensional), which is odd. Since by assumption A/(0)p'(l) > 
0, this eigenvalue is strictly positive. Thus 1/ (X'(O)p'(l)) is a 
bifurcation point. As there can be only one eigenvalue of T, 
there can be at most one bifurcation point (Theorem [2j. Thus 
the first conclusion of Theorem Q] holds true: the connected 
component of fixed points containing the bifurcation point 

( x'(0)p'(i) '°) is unbounded. 

Of course, for this simple example we even have an explicit 
characterization of this connected set of fixed points and 
an application of the powerful KR theorem is not needed. 
But for only slightly more elaborate examples an explicit 
characterization is typically no longer available. 

Consider now transmission over the Binary Symmetric 
Channel (BSC) with transition probability p and min-sum 
(MS) decoding. For iteration I, let M^_ >n be the message 
sent from check node m to variable node n and M„_ >m be 
the message sent from variable node n to check node m. We 
denote the set of neighbors of a node m by 9\£ (m) . If we 
assume that we represent messages as log-likelihood ratios 
then the processing rules in each iterations are as follows: 

1) Processing rule at check nodes — for each m and each 

n € 5\£ (m), 



M, 



(0 



n' — >m 



(i) 

2) Processing rule at variable nodes — for each n and each 

m G 5\£ (re), 

( " - L n+ E MK„, (2) 
m'GiV^ {n)m 



m 



where L n denotes the initial log-likelihood ratio received 
by node n. 

We claim that there exist a one-to-one mapping between the 
messages of the min-sum decoder and the set of integers Z. 
More precisely, the messages of the min-sum decoder are of 
the form zln-^,z € Z. This can be easily seen by induction. 
The initial messages from the variable nodes to the check 
nodes are ±\n^—?-. At the check nodes if all the incoming 

messages are of the form /In -^2, then by inspecting the check 
node processing rule given in Equation (fl~|i we see that the 
outgoing message is again of this form. At the variable nodes, 
all the messages are added up which clearly preserve this 
property. We can therefore equivalently formulate message- 
passing under min-sum on the lattice Z by assuming that the 
initial messages are from the set {±1} and have probabilities 



(1 — p) and p, respectively. 

In order to be able to apply the KR theorem, below we 
consider bounded versions of min-sum, i.e., we bound the 
absolute value of the messages to M, where M is a fixed 
integer. More precisely, we assume that message alphabet is 
M = {-M,-(M- l),--- , -1,0,1, ••• ,M- 1,M}. As men- 
tioned before, M c = { — 1,1}. The message passing rule for 
the check node side is the same as given by Equation (Q3. 
On the other hand, to enforce the boundedness constraint, we 
need to slightly modify the message-passing rule for variable 
nodes. For a node of degree d v the rule is defined by: 

3/ s.t. mi = M 
M $j s.t. rrij ^ -M 



•P v (mo,mi,--- ,m dv _ l ) = < 



3/ s.t. nti = -M 
-M $ j s.t. rrij ^ M 

3iJ s.t. 

i nti — —M, ntj = M 



Q ( Tfjlo 1 m i ) otherwise, 

(3) 

where the quantization function Q(x) — M if x > M, Q(x) — 
—M if x < —M and equal to x otherwise. Note that the exact 
rule for the case when both M and — M are incoming to the 
variable node is not really important since this should hardly 
ever happen if M is large enough. This is because if M is 
large, the quantized decoder will mimic more and more the 
min-sum decoder. 

For future reference, consider the ensemble 
(A(jc) = OAx 2 + 0.6;c 5 ,r(x) =x 4 ). It has design rate r = 0.05. 
The Shannon threshold for this rate is p sh = 0.369. Table U 
shows the threshold values of this ensemble for increasing 
values of M as well as the threshold under true min-sum 
decoding. We see that the thresholds for finite M quickly 
converge to the unbounded case. Note that this quantizer and 

Ml 2 3 4 5 

mp* 0.0319 0.0962 0.0974 0.1219 0.1318 0.148 

TABLE I: Thresholds of A(x) = OAx 2 + 0.6x 5 , F(x) = x 4 under 
quantized min-sum decoding. 

the message passing rules satisfy the symmetry conditions 
of [7]. Thus we can perform the density evolution under the 
all-one codeword assumption. Recall that the alphabet has 
2M + 1 elements. But since the probability of the individual 
elements sums up to one, the density evolution recursion 
G can be written as a function of 2M variables. Thus, the 
underlying space is X = R 2M . As can be easily seen, the 
density evolution map is again a vector polynomial map. 
Thus such a map is completely continuous by Lemma [T] and 
Hypothesis 1 of Theorem Q] is satisfied. The first condition for 
the second hypothesis to hold true is that G(p,0) =0. Note 
that x = implies that with probability one, the message is 
equal to M. Now at the check node side if all the incoming 
messages are equal to M, then the outgoing is also equal 



to M. The same holds true for the variable node side by 
the definition of *P V given in Equation (01. Also the channel 
transition probability p appears only as p and I— p. Thus 
the Frechet derivative of the map is of the form pT + T', 



where both 7\ 7" e R 



2Mx2M 



In order to satisfy Hypothesis 2 



of Theorem Q] we need to modify the density evolution map. 
We use Lemma [3] and consider the derived map with Frechet 
derivative p{hht — T')~ l T. 

Example 2 (Min-Sum Decoder with M = 2): For our run- 
ning example consider M — 2. The Frechet derivative is of 
the form pT + T', where T' is not identically zero. Fortunately 
(I4 — 7"') exists. As mentioned before, by Lemma[3]we need 
to study the eigenvalues of the matrix (74 — T')~ l T. The matrix 
(I4 - T')- l T has eigenvalues = 3.50027, ± = -2.70249 
and the other two eigenvalues are zero. Both — and — have 
multiplicity one (i.e., the multiplicities are odd). This implies 
that the KR theorem is applicable to both the eigenvalues 
and at least one of the conclusion of the KR theorem must 
hold true for both of them. In particular (pi,0) and (/J2,0) 
are bifurcation points. Let C w and C n be the fixed point 
component containing p\ and p2 respectively. Now by the KR 
theorem either the fixed point connected component C w and 
C K are unbounded or Cu, = C n . 

We can compute the fixed points explicitly in this case. The 
result is shown in Figure [3] Since the fixed points are elements 
of R 4 we need to project them into R in order to be able to plot 
them. We choose to apply the error probability operator. As the 
density evolution is done assuming that the all-one codeword 
has been transmitted, so the error probability operator sums up 
the component corresponding to negative indices and adds to 
this sum half the weight of index zero as it is like an erasure. 



i=-M 



2~' 



(4) 



As we can see, the second conclusion of Theorem Q] holds 
i.e. Cm = C/j 2 — Cp. The fixed point connected component 
containing the point a= (pi,0) = (0.28569,0) also contains 
the point d= (/J2,0) = (—0.37003,0). In the component Cu, 
the branch from a to b is stable, b to c is unstable and c to d 
is stable. The component C' is stable. The threshold is p* = 
0.0962. The fixed point of iterative decoder at the threshold 
is represented by point e of the fixed point component C'. 
Above the threshold, the fixed points of iterative decoder 
moves upward along C' as the channel transition probability 
p increases. 

Example 3 (Min-sum decoder with M = 3): For our run- 
ning example we consider M = 3. The Frechet derivative is 
again of the form pT + T', In this case also the inverse (4 — 
T') -1 exists. By Lemma[3] we need to study the eigenvalues of 
(I(, — T')~ i T . The matrix (4 — T')~ l T has the only non-zero 
real eigenvalue as - = 2.09804 and its multiplicity is one. So 
the KR theorem is applicable in this case. Note that as there 
is only one non-zero eigenvalue, there can be at most one 
bifurcation point by Theorem 12 Thus the second conclusion 
of KR theorem can not be true. This implies that the first 
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Fig. 3: Fixed point components for 5 point quantizer. 



conclusion holds: there is an unbounded component Cu of fixed 
point containing the bifurcation point p. In this case also we 
can compute this component explicitly. As the fixed points 
are element of R 6 , in order to plot them we project them 
to one dimension by the error probability operator given in 
Equation [4] The plot is shown in Figure [4] The bifurcation 
point is a=(//,0.0) = (0.476636,0.0). As far as the stability of 
the fixed point in C M is concerned, the branch a to b is stable. 
The fixed points in branch b to c is unstable and from point c 
onwards the fixed points are stable. The point e represents 
the fixed point at which the iterative decoder get stuck at 
threshold p* w 0.0974. Above the threshold, the fixed points 
of iterative decoder moves upward along as the channel 
transition probability p increases. 
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Fig. 4: Fixed point components for 1 point quantizer. 

Discussion: We presented the examples M = 2 and M = 3. It is 
tempting to increase M and see how the fixed point structure 
changes. By taking M to infinity, one would hope to recover 
the structure of the fixed point components of the un-quantized 
min-sum decoder. 

Example 4 (Decoder with Erasure): The decoder with era- 
sure was introduced in [7]. The underlying channel is BSC(p). 
On the variable node side the message-passing rule for a node 
of degree 1 reads 

*F v (mo,mi,--- ,mi-i) = sgn ^tn + £j rn^j . 

The rule for a check node of degree r is 

r-l 

*P c (mi,-" ,m r _i) = Y[ m i 
i=i 

Note that for this decoder if there are degree two variable 
nodes then the threshold is i.e. can not be a fixed 
point. To see this, suppose that all the incoming messages to 
variables nodes are equal to one. Then with probability p, the 



outgoing message from a variable node is equal to 0. Thus 
the probability of is equal to A-2/?. Hence we assume that 
A-2 = 0. For this example M = 1, hence the underlying space 
is X = R 2 . The density evolution equation can be found in 
[7]. The Frechet derivative of the density evolution map can 
again be computed and it turns out that its only eigenvalue 
is 2A-3p'(l). But now this eigenvalue has even multiplicity. 
So we can not apply the KR theorem to this case. In [6], 
it was investigated if the conclusions of the KR theorem is 
still applicable to an eigenvalue of even multiplicity. We are 
currently investigating whether the result of [6] is applicable to 
the decoder with erasure. However numerical computation of 
fixed point suggest that indeed 2 x 3 p'(i) * s a bifurcation point. 
For example, in Figure [5] we plot the fixed point component 
of (3,6) regular ensemble. For this ensemble 2A,3p'(l) = 10, 
so supposedly p = 0.1 is a bifurcation point. We can see 
from Figure [5] that point a which corresponds to p — 0.1 is 
indeed a bifurcation point. The threshold for this ensemble 
is p* = 0.07080 The point b represents the fixed point at 
which decoder get stuck at the threshold. The branch a to 
b is unstable. From b onwards the fixed points are stable. 
P e (x) 
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Fig. 5: Fixed point component for the decoder with erasure for (3,6) 
LDPC ensemble. 

IV. Outlook 

We have shown how the tools of non-linear analysis can 
be used in proving the existence of fixed points. Our ultimate 
goal is to understand the fixed point structure of the BP and 
the min-sum decoder. For the min-sum decoder we hope to 
accomplish our goal by considering a sequence of quantized 
decoders where the number of quantization points tends to 
infinity. Whether a similar strategy can be devised for the BP 
decoder is still an open question. 

Appendix 

Lemma 1: Every vector polynomial map G : R x R N — > R N 
is a completely continuous map. 

Proof. Consider any bounded set S in R N . As S is bounded, 
so will be all the components G,(5). Hence the set G(S) is 
also bounded. Clearly this would imply that the closure G(S) is 
also bounded. In a finite dimensional vector space a closed and 
bounded set is a compact. Hence G(S) is relatively compact. 
Thus the map G is Completely continuous. □ 

Lemma 2: Let G : R N — ► R N be a vector polynomial map 
such that G(0) = 0. Then G is Frechet differentiable. The 

'This assumes that in the first iteration we set the weight of the channel to 
2 and in all subsequent iterations to 1. 



Frechet derivative T of G is a matrix whose entries are given 
by {tij} where 1 <i,j <N and 

d_Gj_ 

' J ~ dx J x=o' 

Proof. Consider ||G(x) — Tx\\. As |x,-| < ||x||, there are no 
linear term in G(x) — Tx and G(0) = implies that ||G(x) — 
Tx\\ = o (||x|| 2 ). Hence 

^^ = »<IMI). 

Il x ll 

This proves the lemma. □ 

Note that Hypothesis 2 of Theorem[T]implies that the param- 
eter y must appear multiplicatively in the Frechet derivative. 
But in many cases we see that the Frechet derivative is of the 
form yT + T'. The following lemma says that in this case also 
the KR theorem can be applied provided the linear operator 
I — T' is invertible. 

Lemma 3: Let G : KxR" — > R" be a vector polyno- 
mial map and Frechet differentiable with Frechet deriva- 
tive yT + T'. Let us assume that (I n — T')~ l exists. Let 
F(y,x) = (I n -T'y l (G(y,x) - T'x). Then F is a vector poly- 
nomial map and Frechet differentiable with Frechet derivative 
y(/„ — T')~ T. Also the set of fixed points of F is same as 
set of fixed points of G. 

Proof. The fact that F is a vector polynomial map is obvious. 
For the Frechet differentiability of F we need that F(y,0) = 0. 
Now, F(y,0) = {I„~T'Y l (G(y,0)-7"0)=0, as G(y,0)=0. 
Now the Frechet derivative of (G(y,x) — T'x) is given by yT x. 
This implies that the Frechet derivative of F (y,x) is equal to 
y{I n — T')~~ T. To see that F and G have the same set of fixed 
points, let x be a fixed point of G. Then G (y,x) — T'x — x — T'x 
which implies (I„ — T')^ 1 (G (Y,x) — T'x) = x i.e. F (j,x) = x. 
□ 
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